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Abstract - High performance control design for a flexible 
space structure is challenging since high fidelity plant 
models are difficult to obtain a priori. Uncertainty in 
the control design models typically require a very robust, 
low performance control design which must be tuned on- 
orbit to achieve the required performance. A new proce- 
dure for refining a multivariable open loop plant model 
based on closed-loop response data is presented. Us- 
ing a minimal representation of the state space dynam- 
ics, a least squares prediction error method is employed 
to estimate the plant parameters. This control-relevant 
system identification procedure stresses the joint nature 
of the system identification and control design problem 
by seeking to obtain a model that minimizes the differ- 
ence between the predicted and actual closed-loop per- 
formance. This paper presents an algorithm for iterative 
closed-loop system identification and controller redesign 
along with illustrative examples. 
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1. Introduction 


Implicit in the design of high performance control sys- 
tems is the availability of an accurate model of the 
system to be controlled. Although system identifica- 
tion and control design are both critical aspects of high 
performance model based control design, the theoreti- 
cal foundations of these two disciplines have developed 
distinctly. Developments in system identification have 
been directed toward obtaining accurate nominal models 
with bounds on the associated uncertainty. Recognizing 
this dependence on accurate nominal design models, ro- 
bust control theory has been developed to accommodate 
modeling errors. Recently, attention has been drawn to 


Anthony J. Calise 
School of Aerospace Engineering 
Georgia Institute of Technology 
Atlanta, Georgia 30332 
(404) 894-7145 

anthony.calise@aerospace.gatech.edu 


the fact that the issues of system identification and con- 
trol design must be treated as mutually dependent . In 
Ref. [1], Skelton points out that since the magnitude 
and spectrum of excitation forces are controller depen- 
dent, an appropriate model for control design cannot be 
determined independent of the controller. The point is 
made that the validity of the model is dictated by the 
controller instead of the opposite, as is usually assumed. 
Since the model that is most appropriate depends on the 
control design, the open-loop response of a model is not 
sufficient to indicate the fidelity of the model for control 
design. Additionally, robust performance requires an ac- 
curate model of the plant in the controller crossover fre- 
quency range [2], indicating that the amount of model 
error that can be tolerated is frequency and controller de- 
pendent. Hence, the issues of model identification and 
model based control design must be treated as a joint 
problem suggesting an iterative solution [I], [3]. 

Closed-loop system identification, (i.e. identification of 
the open-loop plant given closed-loop response data and 
knowledge of the compensator dynamics), is currently 
a field of active research. Most of the methods that 
identify state space models of the open-loop plant are 
based on identifying the closed-loop Markov parameters 
from frequency response functions and then extracting 
the open-loop Markov parameters. A discrete time state 
space realization is then obtained from these identified 
Markov parameters. An approach to iterative closed- 
loop system identification and controller redesign is given 
by Liu and Skelton where a state space model is esti- 
mated using the q-Markov Cover algorithm and a con- 
troller is designed using the Output Variance Constraint 
algorithm [4]. q-Markov Cover theory describes all re- 
alizations of a linear system which match the first q 
Markov parameters and covariance parameters of the 
true system generated by pulse responses. First the 
entire closed-loop system is estimated and then using 
knowledge of the compensator dynamics, the plant is 
extracted. However, the identified open-loop plant has 
dimension equal to the controller dimension plus the di- 
mension of the identified closed-loop plant. Model order 
reduction is used to remove the superfluous states. A 
similar approach is taken in Ref. [5] where Phan et al. 
formulate a method which first obtains the closed-loop 
Markov parameters and then the open-loop Markov pa- 


rameters are recovered. A discrete time state space re- 
alization is then obtained from the Markov parameters. 
Other related approaches are given in Refs. [6] and [7]. 

To provide synergism, an iterative process should match 
the system identification objectives with the control de- 
sign objectives. Ref. [3] presents an iterative algo- 
rithm for frequency-response identification from closed- 
loop data and robust control design. The identification 
phase is control oriented with the objective of provid- 
ing robust performance by closely approximating the 
achieved closed-loop performance. The interplay be- 
tween identification and control design is formalized by 
specifying a performance metric (norm) for model based 
optimal control design and an identification cost func- 
tion that minimizes the difference in the achieved per- 
formance and nominal design performance as defined by 
the same metric. Many algorithms have been developed 
based on this general framework which utilize different 
performance norms and identification algorithms. An 
excellent survey of this topic is given in Ref. [8]. Most 
of the work cited therein has been done in the context 
of single-input, single-output (SISO) systems. 

A classical approach to parameter estimation which has 
been extended to closed-loop system identification is the 
prediction error approach [9]. This optimization method 
estimates the parameters of a linear system by minimiz- 
ing the squared sum of the errors between the actual 
measurements and the predicted measurements. Zang, 
Bitmead, and Gevers present an iterative prediction er- 
ror identification and control design algorithm based on 
the #2 norm [10]. The control objective is used to fre- 
quency weight the identification cost functional and the 
resulting prediction error spectrum is used to frequency 
weight the control design. In this manner the control 
is penalized heavily where the SISO transfer function 
model fit is poor and the model is weighted to fit best 
in the regions most critical to performance. Another 
approach utilizes the dual Youla parameterization of all 
plants stabilized by a given controller. This approach 
was introduced by Hansen and Franklin [11] and further 
elaborated by Hansen, et ai in Ref. [12] as applied 
to closed-loop experiment design. Schrama applied the 
dual Youla parameterization to closed-loop system iden- 
tification in Refs. [13] and [14] as did Anderson and 
Kosut in Ref. [15]. A related method directed toward 
identification of the coprime factors of the plant was in- 
troduced by Schrama in Ref. [13] and was further elab- 
orated in Refs. [14] and [16]. 

In this paper the prediction error method is extended 
to closed-loop identification for multivariable systems. 
Building on a method developed for estimation of the pa- 
rameters of an open-loop system in canonical form from 
open-loop data, a new procedure for closed-loop system 
identification is developed and demonstrated. 


2. Background 


The traditional approach to control design is to obtain 
a nominal model of the plant, P y which is the basis for 
control design. Since P is an approximation of the true 
plant, P, the model based compensator, Cp ) must pro- 
vide a certain level of robust stability (i.e., Cp must in- 
ternally stabilize P and P). In the system identification 
process an attempt is made to bound the model error 
|| P — P ||, which determines the amount of robustness 
required by the control design. It is also desirable that 
the controller provide some level of performance robust- 
ness; that is the achievable performance should not differ 
significantly from the nominal design performance. High 
performance control design for a flexible space structure 
is especially challenging since high fidelity nominal plant 
models are difficult to obtain. The large error bounds 
that result typically require a very robust, low perfor- 
mance control design which must be tuned on orbit to 
achieve the required performance. 

An upper bound on achievable performance is [3], [14] 

II J{P,Cp) ||< 

II J(P , Cp) II + II J(P , c p ) - J(P , Cp) II (1) 

where 

|| J(P, Cp) || : the achieved performance 

|| J(P ) Cp) || : the nominal performance, and 

II J(P,Cp) — J(P,Cp) II : the 

performance differential. 

The choice of a specific performance metric J and norm 
|| * || is determined by the control design methodology. 
To achieve high performance requires 

• high nominal performance 

Ml J(P,Cp) II small) 

• robust performance 

Ml j(p,c p )-j{p,cp) ||«|| J(P,Cp) ||) 

The second condition is actually a requirement on model 
fidelity and indicates that the nominal closed-loop sys- 
tem model must closely approximate the actual closed- 
loop system performance when the compensator Cp is 
used. Therefore, the “fitness” of the nominal model is 
a function of the compensator and must be judged from 
a closed-loop perspective. This fitness is not guaranteed 
by good open-loop model matching nor is it precluded 
by poor open-loop model matching [1]. 

When the model error || P — P || is large, stability 
and performance robustness necessitates a low author- 
ity controller. Since a low authority controller is not 
as sensitive to model errors, the performance differential 



will be small as compared to high authority controllers. 
However, the performance may not be satisfactory. To 
achieve high performance, the issues of modeling and 
control design must be treated as a joint problem. The 
fitness of the design model P is a function of Cp, which 
is itself a function of the design plant. In some cases, high 
performance control design requires an iterative closed- 
loop system identification and control design procedure. 

A new closed-loop system identification method is pre- 
sented in this chapter which is one step of an iterative 
closed-loop system identification and control design pro- 
cedure. It is assumed that a moderately accurate dy- 
namic model of the system to be controlled is available 
for the initial low authority controller design. However, 
this initial design model is not of sufficient fidelity to 
permit high authority control design. The objective of 
the closed-loop system identification procedure is to re- 
fine the initial control design model based on closed-loop 
response data. 

In the development of a closed-loop system identifica- 
tion method, consideration must be given to the non- 
uniqueness of the triple (A, #2,62) in ^he identified real- 
ization. Although there are an infinite number of equiva- 
lent state space realizations for a system, a system with 
n states, nu inputs, and ny outputs can be uniquely 
expressed with a minimum of n(nu T ny) parameters. 
Having as the objective of the closed-loop system iden- 
tification process the ability to refine an existing de- 
sign model, one approach which circumvents the non- 
uniqueness problem is to realize the open-loop system 
matrices in a unique, minimal form and directly iden- 
tify the canonical parameters from closed-loop response 
data. Denery has developed a method of parameter esti- 
mation for multivariable state space systems from open- 
loop test data using canonical forms [17], By utilizing 
the structure of the closed-loop system matrices, an ex- 
tension of Denery ’s algorithm is developed herein to esti- 
mate the plant parameters based on closed-loop response 
data. 

Proper selection of the objectives of system identification 
and control design further stresses the joint nature of the 
identification and control problem. Based on the predic- 
tion error method, the objective of the new closed-loop 
identification procedure developed in this chapter is to 
obtain a model P that minimizes the performance differ- 
ential || T—T H2 where T is the actual closed-loop system 
and T is the identified closed-loop system. This system 
norm cannot be evaluated since T is not known. How- 
ever the actual and predicted closed-loop measurements 
are known and an equivalent objective is to minimize the 
prediction error of the closed-loop system, || y—y H2 - The 
actual and predicted closed-loop system outputs, y and 
y, respectively, are determined for the same set of inputs. 
The least squares cost functional for control dependent 
closed-loop system identification then is 

J = \j\y-y) T W(y-y)clt (2) 


where W is a constant matrix chosen to weight the rela- 
tive importance of different measurement outputs. The 
control objective is matched with the identification ob- 
jective by designing the controller to minimize the H 2 
criterion || T U2 • 

The rest of the paper is structured as follows. First, 
the algorithm developed by Denery for open-loop sys- 
tem identification procedure is presented in detail. Next, 
the extension of the canonical system identification algo- 
rithm to closed-loop system identification is presented. 
Finally, an algorithm for iterative closed-loop system 
identification and control redesign is presented along 
with illustrative examples. 

3. System Identification Algorithm 

In Ref. [17], a two-step procedure is given which gen- 
erates parameter estimates based on noisy measurement 
data. The algorithm begins with an equation error pro- 
cedure, which is similar to a linear observer, to generate 
an initial estimate of the parameters. Noisy measure- 
ment data may cause the equation error estimates to be 
biased, but they are sufficiently accurate to initialize the 
second step, an iterative quasi-linearization output error 
procedure. Since the structure of the two procedures are 
identical with one exception that will pointed out in the 
following, these two procedures are combined to form an 
iterative algorithm that is robust to initial parameter es- 
timates and relatively insensitive to measurement noise. 
First, the details of the equation error procedure will be 
presented, followed by the output error procedure. 

Equation Error Procedure 

Consider a model of the state space system to be iden- 
tified: 

z = Tz + Qu, z(0) = zq (3) 

y = %z (4) 

The objective is to identify some T, Q , 71, and zq which 
represents the dynamics of the unknown system based on 
knowledge of the inputs, u(<), and noisy measurements, 
y(t ). An estimate of the unknown parameters may be 
obtained by minimizing the cost functional given in Eq. 
2. Directly minimizing J results in a nonlinear optimiza- 
tion process, but in the absence of measurement noise, 
a linear formulation may be obtained. Recognizing that 
for a perfect model the output in Eq. 4 will exactly equal 
the measurements and y — y = 0, this difference can be 
fed back to the model with arbitrary gains 1C and M 
according to 

i = Tz + Qu + K(y — Tiz) (5) 

y = Tiz + M{y - Tiz) (6) 

which can also be written 
z — 


Fn* + Gnu + SQu + ICy 


(7) 



z(0) = zno 4" 8zq 

(8) 

V = TtNZ 

by use of the definitions 

+ My 

(9) 

Tn = 

T-KU 

(10) 

Gn = 

g-sg 

(11) 

7Ln — 

(i-M)n 

(12) 

ZNO — 

— Szq 

(13) 


The elements of (T — K,7i) and (I — MU) may be chosen 
independently of the unknown elements of F and 71 by 
using a maximum of n * ny parameters in 1C and M 
when the structure of the system is in a specific form. 
As a consequence, Tn> Gn > 7Ln, and zn o are chosen and 
the unknown parameters are contained in 1C, M ) 8Q, and 
Szq. 

The structure of the system must be such that the un- 
known parameters in T are coefficients of measured 
states. To obtain this structure, Denery developed a 
canonical form for multivariable systems which is anal- 
ogous to a canonical form in Ref. [18] for multi-input 
systems. Denery ’s canonical form is called the observer 
canonical form in Ref. [19], which is dual to the con- 
troller canonical form presented in Chapter III. It can 
be shown that if the plant dimension is an even mul- 
tiple of the number of outputs and the first n rows of 
the observability matrix are linearly independent, then 
the realization is canonical and % will consist only of 
ones and zeros. Otherwise, some elements of 7i will 
be included as unknown parameters in the estimation 
procedure. 

Eq. 9 can now be rewritten as 

y - vn + f(t)t (14) 

where yN is the output of the linearized trajectory 

ijv = Fnzn + Gnu, zn(0) = zno (15) 

yi v = 'Hnzn (16) 

The sensitivity matrix, f(t), is given by 

m = §* in) 

where the vector of parameters to be estimated is 

vec(IC) 
vec{8Q) 
vec(M) 
vec(8zo) 

Using the expression for y from Eq. 14 in the cost func- 
tional, Eq. 2, results in J becoming quadratic in the 
unknown parameters. By differentiating J with respect 
to the unknown parameters and equating the result to 
zero, the estimate of 7 is given by 

7 = y*’ m T Wf(t)dt (19) 

X y f(t) T W(y — y)dt (20) 




or for discrete measurements 

N I _1 

7 = £/(<,) T W7(<.) (21) 

.1 = 1 
’ N 

x £/(<0 T wW')-y(<.)) (22) 

.* = 1 

The i th column of f(t) is y 7l (J), which is the output of 
the i th sensitivity equation 


jin 


r die d{sg) 

+ q — y + —k — u 

dji d~n 

d(Szo) 

dji 

dM 

Unz 7 . + -z — y 

dji 


(23) 

(24) 

(25) 


From 7, the system matrices are obtained by solving Eqs. 
10 - 13 for 71, 0, T , and zq . These values are used in 
<£/v, 71 n, and zno as the initial values for the next 
iteration. 


Output Error Procedure 

If the measurement data used in the equation error pro- 
cedure is corrupted with unbiased measurement noise, a 
bias error will result in the parameter estimates. This 
can be circumvented by using an output error proce- 
dure which yields unbiased parameter estimates based 
on unbiased noisy measurements, provided the initial es- 
timates are sufficiently accurate. Typically the biased es- 
timates obtained from the equation error procedure are 
sufficiently accurate to initialize the output error proce- 
dure. Hence the two procedures form a combined algo- 
rithm for unbiased parameter estimates based on unbi- 
ased noisy measurements. 

The output error procedure implements the method of 
quasi-linearization, which is a well-known approach to 
minimize Eq. 2 subject to Eqs. 3-4. The method 
of quasi-linearization approximates the response of the 
system model by a nominal trajectory ys, based on the 
initial parameter estimates, plus a linearized correction 
about the nominal trajectory. By defining the initial 
estimates T , g , 7i , and Zo to be Tn, 7i jv, and zn o, 

respectively, y may be approximated by y a from 


Z A = FnZa + [p — Pn]zn 

+[gN+sg]u ( 26 ) 

zao = zno+Szq (27) 

y A = 7i N z A + [H~7i N ]z N (28) 

where zn is obtained from 

zn = Fnzn + Gnu (29) 

2jv(0) = zn o, Vn -TInzn (30) 



Using the definitions in Eqs. 10 - 11, and recognizing 
that the initial estimates are sufficiently accurate, im- 
plies 


KM = K[Mn + MM] « KMn (31) 
MM = M[M n + MM] « MM n (32) 


M = 


C 2 0 
0 I 


(43) 


Since the only unknowns in T and Q are the plant ma- 
trices A y B\ } and B 2) the unknown parameter matrices 
are defined as 


Substituting 

these expressions in Eqs. 26 - 28 yields 

za 

= Tnza + + SGu 4- ICyN , 

(33) 

ZAO 

= £/vo + Szq 

(34) 

Va 

= 'Hnza + M y n 

(35) 


which is identical to Eqs. 7-9 except y^ replaces y. 
Using yA in Eq. 2 instead of y reduces the minimization 
problem to a form identical to the equation error proce- 
dure, except j/jv is used in the place of y when computing 
/ in the sensitivity equations, Eqs. 23 - 25. In the ab- 
sence of noise in the measurements, the equation error 
estimate is the same as the quasi-linearization estimate. 


Closed-Loop System Identification Algorithm 


K u 

-K l2 Cc 

0 

0 

SGn 

&G 12 

0 

0 


(44) 

(45) 


In the case of a true canonical form for the plant, H is 
completely known. Note that ICn corresponds to the un- 
known parameters in Ay K\ 2 corresponds to the unknown 
parameters in £ 2 , &G11 corresponds to the unknown pa- 
rameters in B\y and &G 12 = K \ 2 . 


For closed-loop system identification, the partial deriva- 
tive expressions in the sensitivity equations, Eqs. 23 - 
25, are modified as follows and the unknown parameter 
vector is defined as 


Denery’s algorithm is extended to closed-loop system 
identification by expressing the plant in observer canon- 
ical form and exploiting the structure of the closed-loop 
matrices. For the plant given by 


x = Ax 4- B\w + B 2 u (36) 

y = C 2 x (37) 

and a dynamic compensator 

x c = A c x c + B c y (38) 

1* = ~C c x c (39) 


vec(ICn) 
vec(K 12 ) 
vec(SQ h) 
vec(Szo) 


(46) 


For 7 { corresponding to the ( j , k) element of K\\y 



(47) 


and 


ssg dSz 0 _ 

07i ~ i ~ °’ H - 


(48) 


the resulting closed- loop dynamics are 


where ejeJ is a matrix of zeros except for a 1 in the (j, k) 


X 


A 

-B 2 C c ' 

X 

£l2> 





. B c c 2 

A c 

. . 


dK _ 

0 SL 


+ 


' B x 

b 2 ■ 

w 

0 

0 

U 


y - 


o 

X 

0 

| X c 


(40) 

(41) 


dn 


a^c) 


where 


dlC^Cc 

d 7, 


Bit 

0 


— e j 


(49) 


(50) 


As with the open loop algorithm, noisy measurements 
are accounted for by averaging over multiple data sets. 

If the plant (A, #2,62) matrices are expressed in ob- 
server form, then the C 2 matrix consists of ones and 
zeros and the unknown parameters in A are coefficients 
of the measured transformed states. (As stated earlier, 
in some cases the transformation may not be canonical 
resulting in the C 2 matrix having additional nonzero el- 
ements, but these parameters can be estimated as well.) 
It is assumed that the compensator state vector time 
history is recorded. Comparison of Eqs. 3-4 with Eqs. 
40-41 indicates that 


which is an nxnc matrix of zeros except for the j th row 
which is comprised of the k th row of C c . Since SG 12 = 


fC 12, 


dSQ 0 
«7 = [o o' 


(51) 


where ^ - £ 12 = is zero except for a one in the (j, k) 
element. The terms and are identically zero. 
For 7 » corresponding to the (j, k) element of 


dsg 0 

O' oj 


(52) 


T = 


A — B 2 C c 
B c C 2 A e 


Q = 


B\ B 2 

0 0 


(42) 


where a ^ tl is zero except for a one in the (j, k) ele- 
ment and all others are identically zero. Similarly, for 7, 



corresponding to the j th element of Szo , is a zero 
vector with a one in the j th element and all others are 
identically zero. 

Note that this algorithm is not guaranteed to converge. 
Since the estimates are determined by minimizing the er- 
ror in the closed loop time response and not the error in 
the open loop plant parameter estimates, the plant pa- 
rameter estimates may not converge to the “true” plant 
parameters but still provide a good control design model. 




x 2 



Figure 1: Coupled Mass Benchmark Problem 


4. Iterative Control Redesign 
Examples 

The iterative closed-loop system identification and con- 
trol design procedure implemented herein is patterned 
after the approach of Ref. [3] with one notable excep- 
tion to be pointed out below. 


taken with each iteration resulting in fewer identifica- 
tion/control design iterations. Although the iterative 
procedure is not guaranteed to converge, the convergence 
may be checked at each iteration by evaluating the per- 
formance at each iteration. 

Coupled Mass Example 


Iterative Closed-Loop Identification and Control Re- 
design Algorithm: 

1. Beginning with model P, , design a set of H 2 con- 
trollers of varying control authority. 

2. Evaluate actual and estimated output and control 
costs and performance differential. 


As an example of the iterative identification and control 
procedure, the coupled two mass problem illustrated in 
Fig. 1 is used. This example problem highlights robust 
control issues as related to flexible space structures and 
was used as a benchmark problem in Ref. [20] (with 
k\ — 0 and d\ = 0). A disturbance acts on mass two 
and the control force is applied to the first mass. The 
coefficient matrices are: 


3. Determine highest performance control design point 
which satisfies performance differential constraint 
threshold, denoted Cp -. 

4. Using closed-loop data from T(P,Cp { ) and P,-, do 
closed-loop system identification to determine P, + 1 . 

5. Repeat until desired performance is attained. 

This algorithm differs from the framework presented in 
Ref. [3] in that the amount of control authority in- 
crease between iterations is more formally quantified. 
Recognizing that small changes in controller authority 
tend to result in small changes in performance, a con- 
stant scaling factor was used in the control design step 
in Ref. [3] which was slightly increased each identifica- 
tion/control design iteration. Thus the control author- 
ity was gradually increased each iteration until an ap- 
propriate model and high authority control design was 
achieved. In the procedure introduced above, the perfor- 
mance is evaluated for a set of controllers with varying 
authority to ascertain the onset of performance differ- 
ential due to model mismatch. The output and control 
costs for performance assessment are evaluated from the 
mean-square closed-loop output response to white noise 
inputs and the mean-square control signal, respectively. 

Instead of numerous iterations of identification and con- 
trol design, the emphasis is placed on evaluating a set 
of controllers designed for a common model. By ex- 
plicitly evaluating the performance differential for each 
controller, larger steps in control authority may be 


A = 


0 

0 

_ *i±£i 


0 

0 

kg 

_ m /L 

m 2 


1 

0 

_ <h-Ha 

m 2 


0 

1 

."A 

m2 


B 1 


The state vector is x = [xi, 

lT 


0 


0 

0 

, b 2 = 

0 

0 

1/mi 

l/m 2 


0 


(53) 


(54) 


surements are y = [xi, x 2 ] 
C 2 = 


Z2, Zl 

SO 


X 2 \ and the mea- 


(55) 


Two cases will be considered, the first being open-loop 
stable and the second case having a rigid body mode. 
The stable system is described by ki = k 2 = 1.2, mi = 
m 2 = 1.5, Ci — C 2 = 0.1 and the damping constant is 
computed by d, = 2£» y/kijrni- 


The procedure begins with an initial plant for control 
design. As an extreme case, the initial plant is obtained 
by adding 50% error to k\ t A 2 , Cu and C 2 and 5% error 
for each of the two masses. After transforming the true 
(A, [B\ R 2 L C 2 ) triple to observer canonical form, the 
resulting realization is 


At = 


0 -0.8000 

1.0000 -0.1789 

0 0.8000 

0 0.1789 


0 0.8000 

0 0.1789 

0 -1.6000 

1.0000 -0.3578 


(56) 




[Bit B2t} = 


(57) 


0.6667 

0 

0 

0 


0 

0 

0.6667 

0 


C 20 = 


0 10 0 
0 0 0 1 


(58) 


and the corresponding initial triple in observer canonical 
form is 


A 0 = 


0 -1.1429 

1.0000 -0.3207 

0 1.1429 

0 0.3207 


0 1.1429 

0 0.3207 

0 -2.2857 

1.0000 -0.6414 


(59) 


[B10 B20] = 


0.6349 

0 

0 

0 


0 

0 

0.6349 

0 


(60) 


In observer canonical form, the C2 matrix is fixed for a 
given set of observability indices and the columns of the 
A matrix with free elements corresponds to the columns 
of C2 that have an element equal to one. Note that the 
resulting initial design plant elements varied by 79.28% 
and 42.86% in the A matrix, and 4.76% in the B\ and 
B '2 matrices from the truth model. 


A set of LQG controllers of varying authority were de- 
signed for the initial design plant using the weighting 
matrices 



Figure 2: Performance Differential Using Initial Plant: 
Coupled Mass Problem 



W = 


In 0 
0 plnu 


V = 


In 0 

0 Iny 


(61) 


where p is used to vary the control authority. The per- 
formance of this set of controllers was then evaluated 
with both the design model and the truth model to as- 
sess the performance differential that results from the 
initial erroneous model. Recall from the beginning of 
this chapter that the performance differential is a mea- 
sure of performance robustness. Fig. 2 indicates a large 
performance difference at all control authority levels, so 
a controller with a moderate authority level ( p = 5) is 
chosen for initial implementation. 


Using the LQG controller designed for p = 5 with the 
initial design model, the closed-loop is excited with unit 
intensity, zero mean random noise low pass filtered at 25 
Hz. The closed-loop measurements are corrupted with a 
low intensity random measurement noise (the standard 
deviation of the noise was equal to 20% of the standard 
deviation of the measurements). In Ref. [17], measure- 
ment noise is accounted for by averaging over multiple 
experiment sets. In this example, five sets of measure- 
ments are used and the five resulting sets of estimated 
system matrices are averaged. 


Table 1 gives the initial, actual, and estimated parame- 
ters of the system matrices in observer canonical form. 
The significant error is clear as well as the convergence 
of the parameter estimates after 50 iterations. As with 


Figure 3: Convergence of A A (4,3) 


the combined open-loop algorithm, the first 25 iterations 
used the equation error method and the second 25 iter- 
ations used the output error method. The convergence 
over 50 iterations for the correction to the A(4,3) pa- 
rameter is shown in Fig. 3. This parameter corresponds 
to the largest element of 7 (required the largest correc- 
tion) at the first correction iteration. A slight disconti- 
nuity is evident at the 2h th iteration when the algorithm 
switched from the equation error method to the output 
error method. However, this is removed after one itera- 
tion. 

Having refined the initial design model to obtain a more 
accurate model, a second set of LQG controllers is de- 
signed and the performance differential evaluated. Fig. 
4 shows that the gap between design performance and 
achieved performance is considerably decreased at all 
authority levels when compared to Fig. 2. The iden- 
tified model results in robust performance (as defined 
at the beginning of this chapter in regard to perfor- 
mance differential) and good nominal performance. It 
bears pointing out that when the identification exper- 
iment was conducted without measurement noise, the 
achieved performance and design performance curves 
were indistinguishable, indicating that the difference in 
Fig. 4 is due to measurement noise. More averages and 
more iterations could possibly further diminish the per- 





Figure 4: Performance Differential Using Estimated 

Plant: Coupled Mass Problem 





Figure 6: Structural Control Experiment 


eters after 50 iterations. Again, the measurements were 
noise corrupted and the estimates were averaged after 
five identification experiments. Similar convergence of 
the parameter estimates was observed for this case as 
for the open-loop stable example. 

Building Control Example 


Figure 5: Comparison of Achieved Performance: Cou- 
pled Mass Problem 

formance differential. Another perspective is to com- 
pare the achieved performance for a set of LQG designs 
based on the initial plant model with the achieved per- 
formance for the designs based on the estimated model, 
shown in Fig. 5. The difference between the dashed line 
and the solid line indicates the performance increase at- 
tained by performing closed-loop system identification 
and controller redesign. Although the amount of per- 
formance sacrificed by designing the controller based on 
an initial open-loop design model depends on the spe- 
cific plant and control design, Fig. 5 illustrates the fact 
that model error limits achievable performance and bet- 
ter performance can be obtained by refining the model 
to reduce the error. The design point corresponding to 
p — 5 which was used in the closed-loop system identifi- 
cation is indicated by V on Fig. 5. 

A more difficult identification problem is obtained by re- 
moving the spring and damper denoted k\ and d\ on Fig. 
1 resulting in an unstable rigid body mode in the open- 
loop plant. Identification of open-loop unstable systems 
(such as spacecraft) is a difficult task which is a further 
motivation for closed-loop system identification. Using 
the same initial stiffness and damping error, Table 2 in- 
dicates the convergence of the estimated system param- 


A second example is derived from a benchmark problem 
in vibration control of a building subject to an earth- 
quake excitation [21]. The problem is based on an exper- 
imental model of a three-story tendon controlled struc- 
ture at the National Center for Earthquake Engineering 
Research [22] is depicted in Fig. 6. 

A 20 state model is provided in Ref. [22] that was ob- 
tained by system identification experiments on the lab- 
oratory structure. A six state nominal control design 
model was obtained by balancing and residualizing the 
20 state model, retaining modes at 2.268, 7.332, and 
12.240 Hz. Inputs to the six state nominal design model 
are the ground acceleration and control force and the 
outputs are the relative displacements of the three floors, 
which results in 30 parameters to be estimated. An ini- 
tial erroneous design model is obtained by adding 5% er- 
ror to the natural frequency square terms and the B i and 
j 9 2 matrices. Although only 5% error is introduced, the 
maximum errors in the elements of the A , B i, and L ?2 
matrices (in observer canonical form) are 72.2%, 9.9%, 
and 39.6%, respectively. 

Using the initial model, a set of LQG controllers is de- 
signed using p to vary the control authority. For this ex- 
ample, filtered noise is used as input excitation and per- 
fect measurements are assumed. Fig. 7 indicates the per- 
formance differential resulting from controllers designed 
for the initial model, which is relatively constant at all 



Table 1: Comparison of Initial, Actual, and Estimated Parameters For Open-Loop Stable Coupled Mass Problem 


Initial Parameters 

True Parameters 

Estimated Parameters 

-1.1429 

-0.8000 

-0.8240 

-0.3207 

-0.1789 

-0.1832 

1.1429 

0.8000 

0.8252 

0.3207 

0.1789 

0.1993 

1.1429 

0.8000 

0.8219 

0.3207 

0.1789 

0.1720 

-2.2857 

-1.6000 

-1.6531 

-0.6414 

-0.3578 

-0.3815 

0.6349 

0.6667 

0.6672 

0 

0 

-0.0064 

0 

0 

-0.0027 

0 

0 

0.0016 

0 

0 

-0.0004 

0 

0 

0.0113 

0.6349 

0.6667 

0.6733 

0 

0 

0.0039 


Table 2: Comparison of Initial, Actual, and Estimated Parameters For Open-Loop Unstable Example 


Initial Parameters True Parameters Estimated Parameters 


-1.1429 

-0.3207 

1.1429 

0.3207 

1.1429 

0.3207 

-1.1429 

-0.3207 

0.6349 

0 

0 

0 

0 

0 

0.6349 

0 


-0.8000 

-0.1789 

0.8000 

0.1789 

0.8000 

0.1789 

-0.8000 

-0.1789 

0.6667 

0 

0 

0 

0 

0 

0.6667 

0 


-0.8228 

-0.1830 

0.8253 

0.1937 

0.8228 

0.1835 

-0.8231 

-0.1860 

0.6637 

0.0009 

- 0.0011 

-0.0016 

0.0016 

0.0034 

0.6678 

0.0045 







Figure 7 : Performance Differential Using Initial Plant: 
Building Problem 



Figure 8: Performance Differential Using Estimated 

Plant: Building Problem 

control authority levels. A low authority controller is 
used for closed-loop system identification which results 
in an estimated plant with the performance differential 
shown in Fig. 8. For this estimated model there is vir- 
tually no performance differential. 

Discussion 

Since the end objective is an iterative system identifi- 
cation and model-based control design procedure, addi- 
tional constraints are placed on the input and output 
processes. The system identification is based on closed- 
loop test data which mandates that the generalized plant 
for control design consist of actuated inputs and mea- 
sured outputs only. Fig. 9 illustrates this requirement 
where the disturbance inputs, w and w p , act through 
the control input and sensor channels and the perfor- 
mance variables, z and z p , must be linear combinations 
of the sensed variables, y, and the control inputs, u. 
Hence a constraint is placed on the generalized plant 
formulation by the system identification such that the 
columns of B\ and B p lie in the column space of B 2 
and the rows of C\ and C p lie in the row space of C2. 


With regard to the H subproblem, this requires the 
uncertainty representation to consist only of (input or 
output) multiplicative and additive uncertainty models, 
which implies that it is not possible, for example, to in- 
clude parametric uncertainty such as mass or stiffness 
uncertainty in the generalized plant formulation. The 
matrices D21, D2 p , D\ p , and D12 are obtained from 
the input/output uncertainty models and disturbances, 
and do not contain parameters to be estimated. Conse- 
quently, the plant matrices A, f?2, and C2 are the only 
matrices to be estimated by closed-loop system identifi- 
cation. To relax this constraint would require introduc- 
ing additional actuators and sensors for the sole purpose 
of system identification. 

A brief discussion on the closed-loop system identifica- 
tion algorithm from a numerical implementation per- 
spective is warranted. The stability of the algorithm 
is sensitive to several factors. The primary factor influ- 
encing convergence of the parameter estimation is the 
matrix inversion in the computation of 7 (Eqs. 20 or 
22 ). For this inverse to exist, the (ny + nc)xN p sen- 
sitivity matrix / must have full row rank where N p = 
n * (nu + ny + nw) is the number of unknown param- 
eters. Recall that the columns of / are time histories 
of the sensitivity equations, Eqs. 23 - 25 , which include 
the compensator state time histories. If the input is not 
sufficiently rich to excite the measurement and compen- 
sator states, then / will not have full rank. This difficulty 
is compounded as the number of parameters increases. 
If the matrix tends to singularity, the magnitude of the 
elements of 7 diverge. In order to alleviate the diver- 
gence of 7 in the examples above, a relaxation factor 
was introduced that scaled 7. Scaling 7 by a relaxation 
factor of 0.5 typically was sufficient to produce smooth 
convergence as seen in Fig. 3 . Without the relaxation 
factor, the estimates would overshoot and overcorrect, 
resulting in divergence of the parameter estimates. The 
relaxation factor in essence damped the overshoot of the 
correction steps at each iteration. This could possibly 
have been accomplished by using a pseudo-inverse of the 
matrix to zero the small singular values, but that would 
have introduced error. Using the relaxation factor did 
not introduce error but only slowed the convergence. 

5 . Conclusions 

This paper has shown that to achieve high performance 
control often requires reducing model error through sys- 
tem identification. In many cases open-loop testing is 
not possible and even when it is, often the most appro- 
priate model for control design is obtained from closed- 
loop response data. A new method for refining a control 
design model from closed-loop response data is presented 
herein. Based on a prediction error method, the open- 
loop plant parameters are estimated in a canonical form. 
Examples have shown that higher performance can be 
obtained when the controller is redesigned based on the 
refined model. 

A major shortcoming of the closed-loop system identifi- 
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Figure 9: Input/Output Constraint Relationships 


cation procedure is numerical sensitivity. The solution 
procedure presented herein requires the inversion of a 
large data matrix which tends to be ill-conditioned. En- 
suring full-rank of the data matrix requires sufficiently 
rich excitation in all of the modes to be identified which 
is often quite difficult in practice due to limitations such 
as sensor and actuator dynamics. Methods which do not 
involve matrix inversion such as genetic algorithms have 
potential for the closed-loop parameter estimation. An 
additional benefit of genetic algorithms is that the sys- 
tem identification can be operating in the background 
as part of an autonomous identification/controller tun- 
ing process. Future research should be conducted to that 
end. Finally, the measurement noise properties (inten- 
sity, frequency spectrum, etc.) should be explicitly ac- 
counted for in the parameter estimation instead of the 
ad hoc use of ensemble averaging. 
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